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Abstract: We study the properties of an instanton ensemble in three-flavor dense 
QCD which can be regarded as an instanton plasma weakly interacting by exchang- 
ing the rf mesons. Based on this description, we explore the chiral phase tran- 
sition induced by the instanton ensemble at high baryon density in analogy with 
the Berezinskii-Kosterlitz-Thouless transition. Using the renormalization group ap- 
proach, we show that the instanton ensemble always behaves as a screened and 
unpaired plasma. We also demonstrate that the chiral condensate in dense QCD is 
proportional to the instanton density. 
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1. Introduction 

Topological excitations play crucial roles for understanding the properties of vari- 
ous systems in condensed matter physics and particle physics. For example, 0(2) 
spin system in two-dimension is equivalent to a vortex ensemble interacting by two- 
dimensional Coulomb potential; it shows a second order phase transition from a sys- 
tem composed of vortex dipoles to a vortex plasma as temperature increases. This is 
known as the Berezinskii-Kosterlitz-Thouless phase transition [|TJ. Another remark- 
able example is the three-dimensional compact quantum electrodynamics (QED). 
It can be described by an equivalent interacting magnetic monopole ensemble and 
shows a crossover as a function of the coupling constant e [0]. As a result, the area 
law of the Wilson loop, or the confinement of the fundamental charge, persists for 
arbitrary value of e. 

Moreover, the instanton ensemble have succeeded in illustrating many features of 
the vacuum of four- dimensional quantum chromodynamics (QCD) and its hadronic 
observables [[|. Most importantly, it provides a qualitative understanding of the 
spontaneous breaking of chiral symmetry in the QCD vacuum as well as a possible 
mechanism of its restoration at finite temperature: numerical calculations in the 
instanton liquid model show that the chiral restoration corresponds to a transition 
from an unpaired instanton plasma at low temperature to instanton-antiinstanton 
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molecules at high temperature in the physical case of up, down and strange quarks 
I- 

Recently, it was shown in the Ginzburg-Landau approach to three-flavor dense 
QCD H U that the interplay between the quark-antiquark pairing (chiral condensate) 
and the quark-quark pairing (diquark condensate) originating from the instanton- 
induced interaction may lead to a smooth crossover between the hadronic phase 
and the color superconducting (CSC) phase J7J. If such a crossover is realized, the 
coexistence phase of the chiral and diquark condensates extends to the region of high 
baryon density. However, the dynamical roles of the instanton ensemble in such a 
system have not been fully studied in the literatures except for a seminal work on the 
instanton description of two-flavor color superconductivity (2SC) 0. It was shown 
in Ref. |J that the low-energy dynamics of two-flavor dense QCD can be described 
by a nonideal instanton ensemble weakly interacting by exchanging the r] mesons 
due to the fact that the system of instantons is dilute and the U(1)a symmetry is 
asymptotically restored at high density. In such a case, the rj meson can be regarded 
as the lightest asymptotic Nambu-Goldstone (NG) boson. By rewriting the low- 
energy effective Lagrangian of the r\ meson in the Coulomb gas representation via 
a duality mapping, two-flavor dense QCD reduces to an instanton ensemble where 
instantons (antiinstantons) interact with each other by four-dimensional Coulomb 
potential generated by topological charges. 

In the present paper, we will generalize the idea of Ref. || to three-flavor QCD: 
We will first provide a complete derivation and its justification of the instanton 
description of three-flavor dense QCD which was partially suggested but was not 
fully explored in Ref. |J. Then we will investigate the properties of the instanton 
ensemble using the renormalization group approach and show that the instanton 
ensemble behaves as a screened and unpaired plasma. Thus, the chiral condensate 
inevitably exists even at high baryon density regime. This is consistent with the 
previous finding in Refs. || [J and constitute a dynamical demonstration of the 
coexistence of the chiral and diquark condensates at high density. 

Throughout this paper, we will limit ourselves to three-flavor quark matter with 
two light degenerate up and down quarks [ra u = = m u d) and a medium-heavy 
strange quark (m s > m ud ) at zero temperature and at finite baryon density l . We 
remark here that the light 77' meson and the diluteness of instantons enable us to 
treat the instanton calculations under analytical control at high baryon density: This 
is not the case in the vacuum and at finite temperature where the assumption of the 
random instanton liquid needs to be introduced ||. 

The paper is organized as follows. In Sec. |2], after describing the instanton 
ensemble of three-flavor dense QCD, we derive analytical formulas for the instanton 
density, the topological susceptibility and a dense version of the Witten-Veneziano 

1 We will not consider another possibility of the exotic state called quarkyonic phase at high 
baryon density M. 
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relation. In Sec. [|, we show that the system of instantons at high baryon density 
always behave as a screened and unpaired plasma by using the renormalization group 
approach. Also we illustrate that the chiral condensate induced by the instanton 
plasma is proportional to the instanton density. Sec. [| is devoted to conclusion and 
summary. In appendix. |A], we give the mass spectra of meson excitations at high 
baryon density. 



2. Instanton ensemble at high baryon density 



Let us consider how the low-energy dynamics in three-flavor dense QCD can be 
described by a nonideal instanton ensemble weakly interacting by exchanging the rj' 
mesons. Although the method employed in this section is motivated by the approach 
proposed in Ref. ||, a complete derivation and its justification for not-fully-explored 
three-flavor case is given here. First of all, owing to the inverse meson mass ordering, 
< rriK < Tn n < m^, which is caused by the explicit breaking of the flavor SU(3) 



symmetry (m s > m U( i) [T(|, we can focus on the low-energy effective Lagrangian 
of the rj meson at high baryon density. This ideal situation has not been realized 
in the two-flavor case, because only two colors (red and green) participate in the 
2SC pairing and there are not only asymptotically massless 77 meson but unpaired 
(ungapped) blue quarks. 

Our starting point is the three-flavor quark matter where the ground state is 
the color-flavor locking (CFL) color superconducting phase characterized by diquark 



condensates ITT 



(<lKb C( lRc) = £abceijk[d j R ] 



(2.1) 



Here k (a, b, c) are flavor (color) indices and C is the charge conjugation operator. 
We define the rj meson field <p a s 



d T ,d\ 



did R 



(2.2) 



e~ iaA q L . The 



The field (j) transforms as <fi — ► (p + ^atA under the U(1)a rotation 
low-energy effective Lagrangian of the r]' meson at high density is given by [IB], |TJ] 



c 



V{cj>) 



-aM cos( 



(2.3) 



where is the decay constant of the rj' meson and v is the velocity originating 
from the absence of Lorentz invariance in medium. V(4>) is the potential induced 
by one-instanton contribution, ~ Tr^ Mik(d^ L dR)kj with the quark mass matrix 
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M = diag(m u , m^, m s ) and "Tr" is taken over flavor indices. 9 is the theta-angle, M 
is denned as M = TrM and a is a /i-dependent parameter which we will explicitly 
calculate below. We neglect the multi-instanton contributions to V(4>) since they are 
suppressed due to the diluteness of instantons at high baryon density. It should be 



remarked that the term ~ Tr, 



ij 



generates not only the mass of the rf 



M ik (d[d R ) kj 

meson but also those of other pseudoscalar mesons (tt, K and rj). The contribution of 
the 0(M 2 )-term to Eq. ( |2.3| ) does not change our discussion basically and is neglected 
here for simplicity. This will be considered in more detail in Appendix |A]. 

At sufficiently large quark chemical potential compared with the typical scale of 



QCD, /i S> Aqcd, frf and v are found by matching to their microscopic values |L0 

3p 2 2 1 



f~i' 



(2.4) 



8vr 2 ' 3' 

In order to obtain the explicit form of V((f>), let us start with the instanton- 
induced six-fermion interaction [|TJ, [R| |3| : 

~2N C + 1 



inst 



(2vrp)V 
dpn(p) nAT /Ar9 — ^i^i^n 



6N C (N, 



2N c + 4 



(qu 1 qRj 1 )(qLi 2 (lRj2)((lL 



-{(!Lii(iRh){(iLi2(y^qRj2){ ( iLi Z (y^qRj 3 ) + {L^ R) 



+ h.c. 



(2.5) 



8(N C + 2) 

Here p is the instanton size, N c is the number of colors, i 1,2,3 and j'1,2,3 are flavor 
indices and a^ v = §[7^, 7 W ]- The instanton size distribution n(p) is given by [[H], U 



n(p) = C 



N 



8tt 5 



2N C 



p exp 



57T 



g(py 



c 



N 



57T 



g(py 



0.466 exp(-l. 679 AQ 1.34 
(jV c -l)!(jV c -2)! 

11 », 2 
— N c - 
3 3 



-Mog(pA QCD ), b=^N c -^N f , 



(2.6) 
(2.7) 
(2.8) 



where Nf is the number of flavors. Replacing one of qi<lR with M in Eq. ( |2.5| ) and 
taking the expectation value with respect to the CFL ground state ( |2.1| ), where 



\d L \ = \d R \ 



N c + 1 ng 



(2.9) 



with A being the superconducting gap near the Fermi surface, one finds 0, [13], [14 

v{4>) = - 



dpn(p) 



2(2vrp)V 



|dzr2Mcos( 



N C (N C - 1) 

The integration over the instanton size p above results in the form of Eq. 
the coefficient a is given by 



a{n) 



24 



iV c 2 -l 



_ 6+3 

c N N f 2 r 



6 + 3 



S7T- 



2 \ 27V C +1 



A 



QCD 
P 



(2.10) 
where 

(2.11) 
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with T(x) being the gamma function. The well-known infrared divergence in instan- 
ton calculation in the QCD vacuum is not seen here since the instanton screening 
factor, e~ NffJ,2p2 in Eq. ( |2.6| ) fl7|| , gives the small size p ~ of instantons and 
regulate the integral. 

By rescaling <\> —> 2<p/ '(v^3t>/r/) and using the new coordinate x = vr with the 
imaginary time r, the effective action of rf in Eq. ( |2.3| ) reduces to the Euclidean 
invariant form: 

S E = J d 4 x[(d(P) 2 - Acosa(0-0)], (2.12) 

A = -M, a = (2.13) 
v V3vf v > 

We note that the parameter a is a function of chemical potential since f v > ~ fi. The 
instanton potential gives the rf mass as 

ml = -a 2 = —^-y-M, (2.14) 



where the second equation holds from the weak coupling relation, Eq. (|2.4|) . There- 
fore, a — > as fi — > oo from Eq. (|2 .11 ) and the rf meson is a NG boson at high 



baryon density limit. 

Via a dual transformation, the partition function for the action in Eq. Q2.12j ) 
reduces to the following form 0: 

D^Se _ j V( p e -fd*x(d4>) 2 e X fd*x cos a(4>(x)-0) 

= jr Q^fi j d A x t ... j d 4 x N f V^e-^^^e^QMH^-B)^ (2 . 15) 

N±=0 +■ -■ J J J 

where the sum is taken over possible sets of N + (AL) with positive (negative) charge 
Qi = ±1 located at the position Xj. In deriving the second line in Eq. (|2.15|) , we 
have used the relation, 

\cosa(<J)(x) -6) = ^J2 e iQaWx) - 9) . (2.16) 

Q=±l 

Integrating over the variable <fi{x) in Eq. (|2.15|) , one ends up with || 

Z = -^p^ / d A x x ... j d^e-^loQie-^oQiQiGi^i), ( 2 .17) 

N ± =0 +■ — J J 

which is a Coulomb gas representation of the original sine-Gordon model. Since 

the #-angle is conjugate to the topological charge in QCD, Q = J2iQi = — N_ 
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is identified with the total topological charge and iV + (AL) with the number of 
instantons (antiinstantons). Also, 

G(x i -x J ) = —-^ ^ (2.18) 

is the four-dimensional Coulomb potential between instantons (antiinstantons). There- 
fore, Eq. (|2.17 ) exhibits that this system is an instanton ensemble in which instantons 



and antiinstantons with topological charge Qi = ±1 interact with each other by the 
potential G(xi — Xj). 

Note that we can treat our instanton calculations under completely analytical 
control depending on two distinctive facts in dense QCD: 

(i) Instantons are sufficiently dilute indicated by the parameter Aqcd//W "C 1, 
which enables us to deal with the effects of instantons as a perturbation. 

(ii) The inverse mass ordering of pseudoscalar mesons, < < rn^ < 
|[LU|| , guarantees that the low-energy dynamics is dominated by the rj' mesons 2 . 
This is the characteristics with three-flavor and can be confirmed at sufficiently large 
baryon density (See Eqs. ( |A.1| )-( |A?F| ) in Appendix [AJ). 

More quantitative estimate on the domain of applicability of this instanton de- 
scription will be discussed in Sec. f|. 

2.1 Instanton density and topological susceptibility 

In this subsection, we calculate quantities based on the instanton ensemble discussed 
above. 

Multiplying N + (AL) in the right hand side of Eq. ( |2.15| ), one finds the expec- 
tation value of the instanton (antiinstanton) number as 

(N+) = (N-) = yy 4) (2.19) 

with four- volume V4 = J drd 3 x = J dxod 3 x/v. This shows that the average of the 
topological charge (Q) = (N + ) — (N_) vanishes and the instanton density as defined 
below reads 

(AO 

n ins t = V = \v (2.20) 

with A^ = A+ + AL. This result has been obtained in Ref. ||. 

Moreover, by using Eq. ( |2.15| ), we generally obtain the mixed factorial moments: 

NJ NJ \ (\r k+l 



(N+ - k)\ (AL - 0! / \2 



^4 , (2.21) 



2 We neglect the exact massless H boson associated with the breaking of the U(1)b symme- 
try since its dynamics is totally independent here and decouples from the low-energy effective 
Lagrangian of r( ' . 
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for arbitrary nonnegative integers k and I. Eq. Q2.21 ) implies that instantons and 
antiinstantons independently follow the Poisson distribution, 



XI 



(2.22) 



with (3 = = (N)/2, from the fact that the n-th factorial moment of the 

Poisson distribution is equal to f3 n . This Poissonian behavior is usually assumed in 
the QCD vacuum ||, but it can be justified at high baryon density for a dilute system 
of interacting instantons and antiinstantons as anticipated. Also, for the topological 
susceptibility defined by 



Xtop 



v A 



we have a simple relation, 



Xtop — ^inst — Au, 



(2.23) 



(2.24) 



as a property of the Poisson distribution. By the use of Eq. Q2.24 ), the rf mass in 
Eq. Q2.14Q reduces to 3 



2Xto P 



2„,2- 



3/> 



(2.25) 



This is a dense version of the Witten-Veneziano relation JTSf obtained as a natural 
application of the instanton ensemble, which is not given in Ref. ||. 



3. Renormalization group analysis on instanton ensemble 

In this section, we consider the possible phases of instantons at high baryon density 
on the basis of the instanton description in Sec. |2|. In the following, we set 9 = 
for simplicity since all the arguments are independent of the parameter 9. In order 
to explore and compare the general properties of phase transitions induced by the 
.D-dimensional topological excitations (D = 2 for vortices, D = 3 for monopoles and 
D = 4 for instantons), we generalize Eq. (|2.12|) to the D-dimensional sine-Gordon 
model whose action is given by 

S D = J d D x [(d(p) 2 - A D cosa0] . (3.1) 



3r 



The topological susceptibility in Eq. (2.24) and the Witten-Veneziano relation ( |2.25 ) are consis 



tent with the results of Ref. [h4l at high baryon density where the two-instanton term is negligible, 
though the factor v 2 in Eq. ( [2.25| ) does not appear in . This difference comes from the fact that 
our 77' mass is defined to satisfy the dispersion relation E 2 = v 2 (p 2 + m 2 ,) while that in Ref. |f4| 
is the pole mass, i.e., the energy of 7/ at p = 0, ra^° Xc ^ = vm v >. 
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Here a is the parameter with the mass dimension 1 — D/2, which is introduced after 
appropriate rescaling the field <fi so that we normalize the coefficient of the kinetic 
term to be 1. 

The long-range Coulomb force between topological excitations requires effects 
of many-body dynamics or quantum fluctuations. For this purpose, we shall now 
perform the Wilson renormalization group (RG) approach and divide <fi(x) into two 
components, = + 5<f) with low-momentum part < k < A' and high-momentum 
part A' < k < A respectively, where A' is smaller than A by an exponential factor. 
This RG analysis for D = 2 has been already carried out in Ref. and we extend 
it to the case of D > 3 in the following. Considering how the small coupling A <C 1 
with the predominantly Gaussian fluctuations shifts after the RG transformation, 
the change of the potential term can be calculated by integrating out the momentum 
shell A' < k < A as 



\cosa( 

with 



1' + 5(1))) = ~ ^' e - 2 ^) D /2 + Q C }j ? (3 2 ) 



P J (2n) D J A , P 

where is the surface area of a unit sphere in Euclidean D-dimension. Therefore, 
the form of sine-Gordon action, Eq. (|3.1|), is preserved and changed to 



S D -> V = J d D x {{dcj)') 2 - \* D cos atf) , (3.4) 
with the coupling constant 

*d=2 — x A D, 
^*D>3 = eX P 



Ad, (3.5) 



(D — 2)2 D ir D / 2 T(D/2) _ 

for D = 2 and D > 3 respectively. Here we define the renormalization scale x = 
A'/A < 1. At the same time, the kinetic term (<90') 2 is effectively reduced by the 
factor of x 2 < 1 independent of the dimension D, since is of order A and is of 
order A'. 

The systems described by the D-dimensional (D = 2,3,4) sine-Gordon model 
are summarized as follows: (a) two-dimensional 0(2) spin model with the nearest 
neighboring interaction J Q, (b) three-dimensional compact QED with the coupling 
constant e 0, and (c) four- dimensional dense QCD with quark chemical potential 
/i. They are respectively equivalent to an ensemble of vortices, magnetic monopoles 
and instantons interacting by the D-dimensional Coulomb potential. The resultant 
orders of phase transitions are summarized in Table. [| The parameter a in each 
case is also given. 
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D 


topological excitation 


parameter a 


order of phase transition 


(a) 


2 


vortex 


a oc yj J/T 


second order 


(b) 


3 


magnetic monopole 


a oc 1/e 


crossover 


(c) 


4 


instanton 


a = 2/(V3Wy) ~ 1/V 


crossover 



Table 1: : Order of phase transitions of (a) two-dimensional 0(2) spin model with the 
nearest neighboring interaction J Q, (b) three-dimensional compact QED with the cou- 
pling constant e ]2| and (c) four-dimensional dense QCD with quark chemical potential 
[i. In each case, D-dimensional (D = 2, 3, 4) sine-Gordon model is equivalent to an en- 
semble of Coulomb-like interacting topological excitations. Parameters a to exhibit phase 
transitions are also shown. 

3.1 Case (a): two-dimensional 0(2) spin model 

As a pedagogical demonstration, we first recall the ) and consider which is 

overwhelming after the RG transformation, the potential term or the kinetic term 
in accordance with Ref. From Eq. ( |3.5| ), when a 2 /Air > 2, the potential term 
is suppressed by fluctuations so quickly that it is irrelevant compared to the kinetic 
term. Therefore, the system can be described only by the spin wave in this case. In 
the language of the Coulomb gas representation, this corresponds to an insulating 
phase where vortex and antivortex occur in pairs. Otherwise, i.e., a 2 /An < 2, the 
potential term takes over the kinetic term regardless of the initial value of A and 
the system is locked in one of the cosine minima = 27m /a with integer n. This 
corresponds to a plasma phase where the Coulomb potential is screened by the free 
vortices. As a result, the system changes from vortex dipoles to a vortex plasma 
on reaching o 2 /87r = 1 as temperature increases. Also we can easily check that the 
transition temperature T c = J/8n is identical to the prediction obtained from the 
interplay between the free-energy and the entropy of the vortex ensemble [0. 

3.2 Case (b): three-dimensional compact QED 

For D > 3, on the other hand, the kinetic term ~ x 2 vanishes while the potential 
term A remains finite in the limit x — > 0, unlike A also vanishes for D = 2. This 
originates from the fact that the integral in Eq. ( |3.3| ) is infrared divergent only for 
D = 2, but is finite for D > 3. Therefore, the kinetic term is more suppressed than 
the potential after the RG transformation and topological excitations for D > 3 
always behave clS db screened and unpaired plasma. 

As a result, in the case (b), the magnetic monopoles resides in a screened plasma 
phase and show a crossover as a function of the coupling constant e. Since the area 
law of the Wilson loop can be proven for the strong coupling limit e ^> 1, it leads to 
a well-known conclusion that the confinement of the fundamental charge persists for 
arbitrary value of e in the three-dimensional compact QED, which was first shown 
in Ref. @. 
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3.3 Case (c): four-dimensional QCD at finite baryon density 

Let us now turn back to the pending question of our interest, whether the system 
of instantons acts as an instanton plasma or they couple into molecules in the case 
(c). In an analogous fashion to the previous subsection, we find that the system of 
instantons always behaves as a screened and unpaired plasma and shows a crossover 
as a function of f v r ~ //. Since unpaired instantons induce the formation of quark- 
antiquark pairing and give nonvanishing chiral condensate, our result implies that 
the chiral condensate will remain finite in the region of high baryon density 4 . 

More quantitatively, we can calculate the chiral condensate in relation to our 
instanton ensemble. The minimum of the potential V((f>) in Eq. (|2.3|) is given at 
(f) = Q: 

^(0)min = -aM. (3.6) 
Differentiating this energy with respect to M, one obtains the chiral condensate as 

(gg)csc = -a = -^p> ( 3 - 7 ) 

where we have used Eqs. ( [2.13| ) and ( |2.24| ). Eq. ( |3.7| ) is a novel relation connecting 
the chiral condensate to the instanton density in dense QCD. Since the instanton 
density rapidly decreases at high baryon density like ni nst oc A ~ fi 1 ~ b with b = 9 for 
N c = Nf = 3 from Eqs. (]2.8|) and (|2.11|) , the chiral condensate is highly suppressed 
(but remains finite) like (qq) CS c ~ /i 1-6 . 

This is a remarkable consequence, since previous studies using three-flavor effec- 



tive model calculations such as the Nambu-Jona-Lasinio (NJL) model [20 and the 



random matrix model [^T|, exhibit the pure CSC phase without the chiral conden- 



sate is realized at high baryon density. This difference comes from the fact that they 
neglect the effects of instantons in the CFL ground state, which would be a trigger 
of the chiral condensate. Actually, the coexistence phase of the chiral and diquark 
condensates at high baryon density has been recently reported based on the model- 
independent Ginzburg-Landau approach taking into account the instanton effects 
properly |5|, [J. The important point there is that the instanton- induced interaction 
composed of the chiral and diquark condensates: 

£ cx t = ^Tr[(d R d\)(q R q L ) + h.c], (3.8) 

acts an external field for the chiral condensate and leads to a chirally broken crossover 
between the hadronic phase and the CSC phase. Our result of the coexistence phase 



4 The application of our argument here to two-flavor QCD is not straightforward, since there are 
not only light rj mesons but nearly massless unpaired blue quarks in the 2SC phase, as mentioned 
in Sec. ^. However, the instanton liquid model with two-flavor shows a tendency towards chiral 
restoration by forming instanton molecules at high baryon density pl|. 
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at high baryon density is totally consistent with this observation due to the same 
origin of instantons. 

It should be remarked that the chiral condensate in dense QCD is proportional 
to the instanton density in Eq. (|3.7| ), which is in contrast with the case of the QCD 
vacuum with Nf > 2 where the chiral condensate is expected to behave as H 

1/2 
71- 

(qqUc cc -^SSt. (3.9) 
P 

This difference can be understood as follows: The spontaneous breaking of chiral 
symmetry in the QCD vacuum is a collective phenomena caused by the effect of 
infinitely many instantons, and the chiral condensate must be determined from self- 
consistent relations, which finally results in Eq. ( |3.9|) ||. On the other hand, in the 
case of dense QCD, chiral symmetry is broken by a single instanton effect thanks to 
the presence of diquarks as shown in Eq. ( |3.8| ), and it is anticipated that the chiral 
condensate is proportional to the number of instantons N in a four- volume V4, i.e., 
the instanton density ni ns t- 

4. Discussion and conclusion 

In this paper, we have studied the properties of an instanton ensemble in three- 
flavor dense QCD which can be regarded as an instanton plasma weakly interacting 
by exchanging the rf mesons. Based on this description, we derive analytical formulas 
for the instanton density, the topological susceptibility and a dense version of the 
Witten-Veneziano relation. We also explore the chiral phase transition induced by the 
instanton ensemble in analogy with the Berezinskii-Kosterlitz-Thouless transition. 
We generally show that the system of Coulomb interacting D-dimensional topological 
excitations exhibits a second order phase transition for D = 2, and a crossover for 
D > 3 using the renormalization group approach. In particular, for D = 4, the 
instanton ensemble always behaves as a screened and unpaired plasma, which gives 
nonvanishing chiral condensate proportional to the instanton density at high baryon 
density regime of QCD. Therefore, the coexistence phase of the chiral and diquark 
condensates is inevitably expected in dense QCD as suggested in Refs. 0, EJ. 

The discussion on the applicable domain of the instanton description introduced 
above is in order here. Our treatment is based on the low-energy effective Lagrangian 
of the rj' meson, Eq. ( j2.3|) , which is valid when two conditions on the 7/ pole mass 
are satisfied: (i) < 2A, and (ii) m v > < m n ^ Kri . The condition (i) is required 
since, otherwise (m^ > 2 A), 7/ would rapidly decay into a particle- hole pair and 
becomes unstable. Also the condition (ii) is necessary to assure that we have only to 
focus on the low-energy effective Lagrangian of the light 7/ meson. When fi ^> Aqcd, 
rrirf <C 2A as well as the inverse meson mass ordering, < ttik < rn-K < Tn v follows 
due to fl < 1, so that the conditions (i) and (ii) are satisfied (See Appendix |A]). 
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Moreover, we find the critical chemical potential fj, c as /x c ~ IOAqcd for m ud = 5-10 
MeV, m s = 150 MeV and A QC d = 200 MeV. 

The extrapolation of the instanton-induced crossover obtained here to lower 
baryon density is a nontrivial question which we cannot address within our treatment. 
However, it might be reasonable to expect that the system of instantons behaves as a 
gas-like weakly-correlated or a liquid-like strongly-correlated plasma across the entire 
span of the density. The instanton-induced crossover may have relevance to the con- 
tinuity between hadronic phase and color superconductivity phase [^3|, and the 
spectral continuity of hadrons || |2l| from low to high baryon densities. It would be 
also important to study how the confinement-deconfinement phase transition at finite 
baryon density is related to the changes in the behavior of an instanton ensemble 
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A. Mass spectra of meson excitations 



The explicit inclusion of the 0(M 2 )-term does not change our discussion in a sub- 
stantial way. But it is rather essential to validate the low-energy effective Lagrangian 
of the if meson, Eq. ( |2.3D , so that we can neglect other heavier meson excitations. In 
the case of two light degenerate up and down quarks with a medium-heavy strange 
quark, flavor SU(2) symmetry is respected but flavor SU(3) symmetry is not. Then 
we find the masses of pions (ir° and ir^) and kaons {K^, K° and K°) to the order of 
0(M 2 ) 



as 



10, 12, 28, 29 



2a 8C 
-p^rn ud + -^m ud m s 

.J TV J TV 



1/2 



m K±,K0,K0 — T- 



mt — m 



ud 



2/i 



+ 



a , . 4C ' 

— {m ud + m s ) + -^m ud (m s + m ud ) 

.J TV J TV 



1/2 



(A.l) 



(A.2) 



where the first term on the right hand side of Eq. (|A.2 ) is the effective modifications 
of the chemical potential due to the explicit breaking of the flavor SU(3) symmetry 
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27]. The coefficient C and the pion decay constant /„- have been determined from 
weak-coupling calculations at high density fllO |: 



C 



3A 2 
4^' 



j - 



2 21 - 81n2 /i 2 



18 2tt 2 ' 



(A.3) 
(A.4) 



On the other hand, the neutral mesons, rj and 7/, are unaffected by the effective 
chemical potential. However, since 77' mixes with rj, the diagonalization of the 2x2 



mass matrix m 2 ah (a, b = 0, 8), 



771, 



00 



8C 

— FT m ud {2m s + m ud ) 



m, 



08 



8V2C 

8C 



m ud (m s - m ud ), 



(A.5) 



m 



m ud (m s + 2m ud ), 



is necessary to obtain the genuine mass eigenvalues of rj'. Also taking into account 
the instanton contribution to 7/, Eq. ( |2.14|) , their masses finally turn out to be 



m. 



2a 2AC 2 



a . . / 1 2 \ 8C 

— (m u + m d + 4m s ) + _ + _ m ud m s 



(A.6) 



9 



-,1/2 



/jj' 2/ 2 + frf J 3 



-m 



(A.7) 
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